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Abstract of JP1 1288341 
PROBLEM TO BE SOLVED: To detect an 
object, which is the object of the interest of a 
user, based on the line-of-sight direction of the 
user and to output information corresponding 
to this object. SOLUTION: Map information is 
stored in a map data storage part 104. A user 
position detecting part 101 and a user line-of- 
sight direction detecting part 102 respectively 
detect the viewpoint position and line-of-sight 
direction of the user on a map in the map 
information. When the expansion in the pupil 
area of the user is detected by a user pupil 
area detecting part 106, with the detected 
viewpoint position as a starting terminal, a 
control part 103 searches and extracts an 
object on a line segment along with the line-of- 
sight direction out of the map information. 
Then, a voice synthesizing part 105 outputs 
information concerning the extracted object in 
voice. 
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[0022] In the next step 703, the global position of an 

object that a user sees is calculated. Here, the object that 
the user sees lies on a half line [Q] derived by formula 
[Q] = [O] +k [n] , where k>0, using the three-dimensional global 
coordinate [O] of an eye ball of a user obtained in step 701 
and the unit vector [n] of the direction of the user sight line. 
[0023] In a succession of procedural steps after step 704, 

an attribute of the object that the user sees is obtained. 
[0024] First of all, a spatial region in which the user 

eye-ball position [0] is positioned is retrieved in a regional 
database in step 704. The user's eye ball is either left or 
right eye ball. Concerning plane S, [V]x[O]-W<0 is satisfied, 
so that the user's eye ball is positioned in region Sio (Fig. 
8) . Concerning plane S i0 , [ V i0 ] x [O] -W i0 ^0 is satisfied, so that 
the user's eye ball is positioned in region Sioo (Fig. 8). 
Concerning plane Sioo, [Viool x [O] -Wioo^O is satisfied, so that the 
user's eye ball is positioned in region Siooo (Fig. 8). 
Concerning plane Siooo/ [V 10 oo] x [O] -Wiooo^O is satisfied, so that 
the user's eye ball is in region Sioooo (Fig. 8) . Since region 
Sioooo is the terminal node (Fig. 4) , the user eye-ball position 
is obtained and therefore, region Sioooo is the region for first 
retrieval . 

[0025] Next, whether or not there is an object that 

intersects with the half line [Q] in the retrieval region is 
judged in step 705. 

[0026] There is no object that intersects with the half 

line [Q] in region Sioooo (Fig. 4) and the procedural steps move 
to step 706 to obtain the next retrieval region. Since a brother 
region Sioooi of region Sioooo does not intersect with half line 
[Q] (Fig. 9) , region Siooo has no object that intersects with 
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half line [Q] (Fig. 9) . Since a brother region S1001 of region 
Siooo does not intersect with half line [Q] (Fig. 9) , region Sioo 
has no obj ect that intersects with half line [Q] (Fig. 9). Since 
a brother region Sioi of region Sioo intersects with half line 

[Q] (Fig. 9) , region Sioi has a possibility of having an object 
that intersects with half line [Q] (Fig. 9) . Since a child 
region Sioio of region S i0 i intersects with half line [Q] (Fig. 
9) , there is possibility that region Sioio has an object that 
intersects with half line [Q] . But another child region Sion 
does not intersects with half line [Q] (Fig. 9) , the region can 
have no object that intersects with half line [Q] . Child 
regions Sioioo and Sioioi intersect with half line [Q] (Fig. 9), 
region S i0 ioi is nearer to the eye-ball position [O] and is 
therefore assigned as the next retrieval region. 

[0027] After that, step 705 is to be carried out again. 

To begin with, the three-dimensional coordinates of all the 
points registered in region Sioioi are extracted from the 
regional database (Fig. 4). In the illustrated example, points 

[Bi], [B 2 ] , [B 3 ] , and [B 4 ] are extracted. Using these extracted 
coordinates as keys, the name of an object that includes these 
points is retrieved from the coordinate database (Fig. 5) . Here, 
the name "B Building" is extracted. Subsequently, using the 
name "B Building" as a key, retrieval is performed on an 
attribute database (Fig. 6) to obtain triangle patch data ([Bi], 

[B 2 ], [B 3 ]),([Bi], [B 2 ], [B 4 ]), ([Bi], [B 4 ], [B 3 ] ) , and 

( [B 4 ] , [B 2 ] , [B 3 ] ) that show the shape of "B Building", and whether 
or not the triangles intersect with half line [Q] is judged. 

[0028] In this example, the triangles do not intersect with* 

half line [Q] , and the procedural steps moves to step 706 to 
determine the next retrieval region. Since a brother region 
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S10100 of region S10101 intersects with half line [Q] (Fig. 9), 
the region S10100 is assigned as the next retrieval region. 

[0029] Step 705 is performed again to extract the 

three-dimensional coordinates of all the points registered in 
region Sioioo from the regional database (Fig. 4) . Here, points 

[Di] , [D 2 ] and [D 4 ] are extracted. Using these extracted 
coordinates as keys, the name of an object that includes these 
points is retrieved from the coordinate database (Fig. 5) . Here, 
the name "D Building" is extracted. Subsequently, using the 
name "D Building" as a key, retrieval is performed on an 
attribute database (Fig. 6) to obtain triangle patch data ([Di], 

[D 2 ], [D 3 ]),([Di], [D 2 ], [D 4 ]), ([DJ, [D 4 ], [D 3 ] ) , and 

( [D 4 ] , [D 2 ] , [D 3 ] ) that show the shape of W D Building", and whether 
or not the triangles intersect with half line [Q] is judged. 
As a result of judgment, since triangles ( [D x ] , [D 2 ] , [D 4 ] ) , and 

([D x ], [D 4 ], [D 3 ]) intersect with half line [Q] (Fig. 9), the 
value of the intersection between the nearer triangle ([Di], 

[D 2 ] , [D 4 ] ) to the eye-ball position and the half line [Q] , i.e., 
k (>0) is calculated. Further, using distance k from the eye 
point to the object makes it possible to navigate by synthetic 
speech such as "the distance to D building is about 2, 500 m from 
here". 

[0030] Next, the procedural step moves to step 707 to 

extract information concerning M D building", the object that 
the user sees, from the attribute database (Fig. 6), and an 
synthetic voice section 105 outputs voice information "This is 
D Building, the tallest in Japan and is 500 m high". 
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